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Abstract 

We study the stability properties of linear time- varying systems in con- 
tinuous time whose system matrix is Metzler with zero row sums. This 
class of systems arises naturally in the context of distributed decision prob- 
lems, coordination and rendezvous tasks and synchronization problems. 
The equilibrium set contains all states with identical state components. 
We present sufficient conditions guaranteeing uniform exponential stabil- 
ity of this equilibrium set, implying that all state components converge to 
a common value as time grows unbounded. Furthermore it is shown that 
this convergence result is robust with respect to an arbitrary delay, pro- 
vided that the delay affects only the off-diagonal terms in the differential 
equation. 

Keywords; distributed algorithms, coordination, synchronization, stabil- 
ity, communication delay 

1 INTRODUCTION 

We consider a coordination problem for a network of systems interacting via 
local coupling. Each individual system in the network is assumed to have simple 
integrator dynamics. The network coupling is allowed to be time-dependent and 
non-bidirectional. We show that, under very mild conditions, the individual 
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state variables of the systems in the network converge to a common value as 
time grows unbounded. 

Each system in the network may be a kinematic model of a fully actuated 
vehicle and the corresponding state variable may represent its position in one- 
dimensional space. The coordination problem then asks to steer all vehicles 
to a common rendezvous position — which is not a priori given but will depend 
on the vehicles' initial positions. The strategy studied here is of a distributed 
nature. No leader or external coordinator is assumed to be present. Instead the 
desired formation is formed as a consequence of the local interaction between 
the individual vehicles. Other vehicle models may be conceived. Each system 
in the network could, for example, model a particle moving at constant speed in 
two-dimensional space, its direction of motion being represented by the system's 
state variable as in ^E]- More general models are possible, where the individual 
state variables are not necessarily scalar but vector- valued, representing the 
configuration of a vehicle in three-dimensional space. Such higher dimensional 
extensions, however, will not be considered in the present paper. We refer 
to 0131 00 El il El Cni El Ha [SHU for the study of more general swarming 
models and collective motion patterns. 

In a different context of synchronization |15| each system in the network 
could represent an oscillator and the individual system's state variable could 
determine the oscillation phase. In this case the consensus problem corresponds 
to a synchronization problem for the oscillators. The present model may then be 
interpreted as a linearized version of the more complex synchronization models 
studied, for example, in ^1 El E] • 

Finally, the individual systems' state variables could represent an abstract 
decision variable. In this case the network equations represent a distributed 
consensus algorithm for the purpose of distributed decision making as in ^1 
I20L I21L \TIl I23| . Distributed agreement problems have a long history; see, for 
example, the book |^ section 4.6] and the paper 

The distributed consensus algorithm that we consider here has received con- 
siderable attention in the recent literature [^ ITUl ITOl OUlini 1^ 1^ 1^ I77 | . 
Compared with these references, a main contribution of the present paper is 
that we do not impose restrictive assumptions on the network coupling topol- 
ogy (other than a very mild connectivity assumption). We allow for general 
non-bidirectional and time-dependent communication patterns. Unidirectional 
communication is important in practical applications and can easily be incorpo- 
rated, for example, via broadcasting. Also, sensed information flow which plays 
a central role in schooling and flocking is typically not bidirectional. In addition, 
we do not exclude loops in the coupling topology. This means that, typically, we 
are considering leaderless coordination rather than a leader-follower approach. 
(Leaderless coordination is also considered, for example, in 28.. .29i ISUl 1311 
Finally, we allow for time-dependent communication patterns which are impor- 
tant if we want to take into account link failure and link creation, reconfigurable 
networks and nearest neighbor coupling. 

The present work may be seen as a continuation of the author's previ- 
ous work |33l I34j . We extend the discrete-time results of those papers to- 



2 



wards continuous-time distributed algorithms. Furthermore, we show that the 
continuous-time results presented here are robust with respect to an arbitrary 
communication delay, provided that the delay affects only those variables that 
are actually being communicated between distinct systems in the network. Even 
though we restrict attention to linear systems in the present paper, it is instruc- 
tive to observe that our approach is of an inherently nonlinear nature, with a 
non-quadratic Lyapunov function playing a central role. 

The paper is organized as follows. Section |21 introduces the model. Section^ 
gives an overview of various Lyapunov functions reported in the literature. Sec- 
tions^andElpresent the main stability results, respectively for the case without 
delay and the case with delay. 

2 MODEL 

We start with introducing the abstract model that forms the subject of our 
study. We consider linear time-varying systems in continuous time 

X = A{t)x (1) 

where the system matrix A{t) is assumed to satisfy: (a) its off-diagonal elements 
are positive or zero and (b) its row sums are zero. Matrices with positive 
or zero off-diagonal elements arise naturally in the study of positive systems 
and Markov chains. They are sometimes referred to as Metzler matrices pS] 
and their spectral properties are well documented in the literature. The extra 
assumption concerning zero row sums guarantees that each consensus state with 
a common value for its state components corresponds to an equilibrium state. 
What makes the present study interesting is that the system matrix is allowed 
to depend explicitly on time. 

Before we continue our study of ^ let us first provide some background 
and motivation for considering this class of systems; see also [2| El JiSj .201 
1211 1221 123L 1261 1?7] where this model or variants of it have been studied. We 
consider a finite network of systems. (Throughout the paper both the individual 
entities making up the network as well as the overall network are referred to as 
'systems'. No confusion should arise.) The state of each individual system in the 
network, say system fc, is characterized by a real number Xk- The differential 
equations governing the evolution of these variables depend on the network 
interconnection. Let us first consider a simple network structure with only one 
coupling. A link from system I to system k contributes to the dynamics as 
follows 

Xk = aki{xi - Xk) 

which makes the real variable Xk evolve towards xi with a rate of change pro- 
portional to the difference xi — Xk- The coefhcient aki serves as a measure for 
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the coupling strength. In matrix notation we have 
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Of course, wc do not want to restrict attention to single link networks. When 
considering multiple simultaneous couplings we assume that their effect is ad- 
ditive. According to this additivity assumption the dynamics of the network is 
described by x = Ax where the system matrix has positive or zero off-diagonal 
elements and zero row sums. We may briefly refer to such matrices as Metzler 
matrices with zero row sums. 

In general, we want to allow the system matrix to depend explicitly on time. 
The system matrix may vary discontinuously with time, for example, in the 
case of instantaneous link creation or link failure. The system matrix may also 
vary continuously with time when some coupling strengths increase or decrease 
gradually. This could, for example, be the case when the coupling strength 
depends on the distance between systems in physical space. Both continuous 
and discontinuous changes are expected when the network of systems correspond 
to physical entities interacting via nearest neighbor coupling. 



2.1 Graph representation 

It is illustrative to provide a graph representation of the network coupling. For 

this purpose wc associate to any n x n Metzler matrix with zero row sums a 
digraph (directed graph) as follows. We introduce n nodes labelled consecutively 
from 1 to n. Each node represents a system in the network. To each strictly 
positive off-diagonal element of the matrix, say, on the fcth row and the Zth 
column we associate an arc from node I towards node k indicating that the 
state of system I influences the dynamics of system k. The orientation of the 
arc corresponds to the direction of the information flow, namely from system I 
to system k} 

For some purposes we may wish to incorporate a threshold when constructing 
a digraph from a given Metzler matrix. This is particularly uschil when the 
system matrix depends explicitly on time. In this case it may happen that 
some matrix elements converge asymptotically to zero and eventually become 
so small that they hardly contribute to the dynamics. It may be better to 
neglect such small values when representing the network coupling. This may 
be achieved by introducing a threshold value 5 > 0. Only those off-diagonal 
elements whose value is strictly larger than 6 are then giving rise to an arc. As 

^Notice that we do not assign weights to the arcs. It is straightforward to construct a 
weighted digraph by taking into account the precise values of the matrix elements but this is 
not needed in the present context. 
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this construction will be instrumental in the statement of our main results we 
provide the following formal definition (where we allow (5 = in order to include 
the case of no threshold). 

Definition 1 ((5-digraph associated to a matrix). Consider annxn Metzler 
matrix A with zero row sums. The 5-digraph (S > 0) associated to A is the 
digraph with node set {1, . . . , n} and with an arc from I to k (k ^ I) if and only 
if the element of A on the kth row and the Ith column is strictly larger than S. 

It will turn out that the stability properties of ^ may be related to the 
connectivity properties of associated digraphs. In order to prepare for a precise 
formulation of our results we introduce the following concept related to connec- 
tivity. For a given digraph, we say that node I can be reached from node k ^ I 
if there is a path from fc to ^ in the digraph which respects the orientation of 
the arcs. 

2.2 Stability and convergence 

We are interested in the convergence of the individual state components to a 
common value. We may reformulate this convergence property in terms of clas- 
sical stability concepts. The equilibrium set of contains all consensus states 
with a common value for their components. Convergence to a consensus state 
may then be captured by requiring that the equilibrium set of consensus states is 
attractive. More precisely we will be focussing upon uniform exponential stabil- 
ity of the set of consensus states. Sufhcient conditions for uniform exponential 
stability will be formulated in the remainder of the paper. 

If the system matrix does not depend explicitly on time we may, of course, 
perform an eigenvalue analysis. A minor subtlety is introduced by the require- 
ment that the system matrix has zero row sums. Indeed, it is straightforward to 
see that a matrix with zero row sums has a zero eigenvalue corresponding to the 
right eigenvector (1, . . . , 1)' (where the superscript prime denotes transposition). 
This trivial eigenvector determines the equilibrium set {x G R" : xi — ■ ■ ■ — Xn}- 
The convergence property that we are aiming at corresponds to all other eigen- 
values having strictly negative real part. It is a well-known result implicitly 
contained in Sections 7.2 and 7.3] that all but one of the eigenvalues of a 
Metzler matrix with zero row sums have strictly negative real part, the only 
exception being the trivial eigenvalue at zero, if and only if the associated di- 
graph has (at least) one node from which all other nodes may be reached.^ This 
provides a necessary and sufficient condition for the convergence of the indi- 
vidual systems' state variables to a common value. In addition, the spectrum 

^Notice that our construction of a digraph associated to a Metzler matrix is different from 
the construction used in the context of Markov chains. The difference concerns the direction of 
the arcs, which is in the present paper exactly the opposite as in the more familiar construction 
used in the context of Markov chain theory. Stated in terms of the latter convention we have 
that all but one of the eigenvalues of a Metzler matrix with zero row sums have strictly 
negative real part, the only exception being the trivial eigenvalue at zero, if and only if the 
associated digraph has (at least) one node which may be reached from all other nodes. 



5 



of the system matrix provides a quantitative measure for the speed of conver- 
gence; cfr. ^l^ll^niESj. A further advantage of spectral analysis is that, at 
least in principle, it extends to the case of delayed communication, although the 
explicit determination and characterization of the spectrum may become more 
involved. (A useful result in this context is the Gersgorin theorem pS]; see, 
e.g., 1201 1^-) An obvious disadvantage of this approach is that it is limited 
to time-independent system matrices and that the results are only locally valid 
when applied to nonlinear systems. 

3 LYAPUNOV FUNCTIONS 

Various approaches are available to analyse the convergence properties of 
In particular, several Lyapunov functions have been proposed in the literature. 
The existence of a Lyapunov function may yield useful insight in the system's 
qualitative behavior. In addition, a Lyapunov function may point towards gen- 
eralizations of the present theory to more complex coordination models, possibly 
involving nonlinear and higher order dynamics. In this sense, the present sur- 
vey, although restricted to the particular system may be used to catalogue 
many of the recent results on coordination and synchronization. 

3.1 Gradient flow 

If the system matrix is time-independent and symmetric, A{t) = A = A' for 
all t, it is convenient to rewrite ^ as 

X = -VV{x) (2) 

where we have introduced the potential function V{x) = —x' Ax/2 and where 
WV{x) denotes the gradient of V at x: W{x) = [dV/dxi, . . . ,dV/dx„)' . It 
is clear that the equilibrium points of ^ correspond to stationary points of V 
and that away from these points the potential is strictly decreasing with time: 

V{x) = -\\VV{x)\\\ 

This reformulation of the dynamics may serve as a starting point of a stabil- 
ity analysis which relates the stability properties of Q with the qualitative 
properties of the potential function V . 

In principle a gradient description is not restricted to the case of time- 
independent system matrices, but its usefulness is limited when the system 
matrix depends explicitly on time. Indeed, in this case the potential func- 
tion V{t^x) — ~x' A{t)x /2 depends explicitly on time and this gives rise to an 
extra term when evaluating the rate of change of V with time: 

V{t,x) = -\\VV{t,x)f ~ x' A{t)x/2. 

(Here we have assumed differentiability of A{t).) As a consequence the potential 
function is not longer guaranteed to decrease along non-equilibrium solutions. 
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unless additional conditions are imposed.^ An important advantage of this 
approach is that it extends to nonlinear interactions, possibly yielding (almost) 
global convergence results. In addition, this approach extends to networks of 
second order dynamic models, where the potential function should be augmented 
with kinetic energy terms in order to obtain a non-increasing energy function; 
see [3^1130]. Finally we mention that, in the case of symmetric coupling, a 
stability analysis based on contraction analysis is proposed in |37| . 

3.2 Sum of squares 

One may try to capture the convergence properties of JQ) by considering the 
sum of squares S{x) = x1 + ■ ■ ■ + x'^ as a candidate-Lyapunov function. At first 
sight this may seem a surprising choice since this function is not positive definite 
with respect to the equilibrium set of all consensus states but its usefulness is 
illustrated next. The time-derivative of S{x) along the trajectories of Q is given 
by S{t, x) = x' {A{t)+A' {t))x and thus we conclude that S is non-increasing with 
time if and only if the symmetric matrix A{t)+A'{t) is negative semi-definite. In 
this respect, the following result is very useful. It states that, one, negative semi- 
definiteness of A{t) + A'{t) is equivalent to A{t) having zero column sums. It 
also shows that the sum of squares function is only a very simple representative 
of a much broader class of Lyapunov functions that are all non-increasing along 
the solutions of (Q. The proof of this puzzling result is very short and elegant, 
and is essentially contained in a 1976 paper by J.C. Willems |38|. 

Proposition 1. Let A be Metzler with zero row sums. The following statements 
are equivalent: 

1. The sum of squares function S(x) is non-increasing along the trajectories 
of X = Ax; 

2. A + A' is negative semi-definite; 

3. A has zero column sums; 

4- Every convex function V{x) invariant under coordinate permutations is 
non-increasing along the trajectories of x — Ax. 

Proof. The fact that|21implies0]follows from |38[ Theorem l(iii)]. We repeat the 
proof of that paper for reasons of completeness. We show that V{exp{At)x) < 
V{x) for every t > 0. It is not difhcult to see that exp{At) is a doubly stochastic 
matrix; that is, a non-negative matrix with all row sums and column sums equal 
to 1. According to a famous result by Birkhoff a doubly stochastic matrix 
may be decomposed into a convex combination of finitely many permutation 
matrices exp(At) = XiPi where the coefficients are non-negative and sum 
up to one and where the matrices Pi have exactly one entry equal to 1 on each 

■^One may, for example, impose the condition that x{t)A{t)x{t) = which may be inter- 
preted as a state-dependent constraint on the time-evolution of the system matrix. 
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row and column and all other entries equal to zero. By convexity of V{x) and 
invariance under coordinate permutations we have 

VieM^t)^) - V{Y^X,P,x) < = ^A,y(x) = V{x). 

i i i 

The implications '21 implies ^ implies |3' are trivial. It remains to show that 
121 implies 121 — a result which is presumably well-known. Let us denote by e the 
vector (1, . . . , 1)'. Using this notation we may write the assumption that A has 
zero row sums in a very concise form, Ae = 0. Similarly, the requirement that 
A has zero column sums corresponds to e' A = 0. In order to prove this, we 
calculate x'{A + A')x = 2x'Ax for the particular case of x = e + eA'e where e 
is a small real number. Using the row assumption Ae = we have the following 
expression for x' Ax 

(e' + ee'A)A{e + eA'e) = e'Ae + e{e' AAe + e'AA'e) + 0(e2) 
^ ee' AA' e + Q{e^) 
= £|A'ep + 0(£2). 

By requiring that this expression is negative or zero for all e we conclude that, 
necessarily, e' A = and thus that the matrix A has zero column sums. □ 

We thus see that the sum of squares function or, more generally, every convex 
function invariant under coordinate permutations is non-increasing along the 
trajectories of |^ if and only if the Metzler matrix A{t) has zero column sums 
in addition to zero row sums. This observation may serve as a starting point 
for a Lyapunov/LaSalle stability analysis. 

The sum of squares Lyapunov function has an appealing interpretation in 
terms of passivity theory. In order to clarify this point, we view the linear 
system x = A[t)x as a feedback interconnection of a multi-input multi-output 
system consisting of n individual integrators Xk — Uk with a static map u = 
A{t)x. The integrators are passive input-output systems with respective storage 
functions xf/2. The feedback interconnection is stable if (minus) the static 
map is also passive; that is, if x'A{t)x < for all x and t, which is precisely 
the requirement we recognize from the above discussion. In this case the sum 
of the individual storage functions x^ + ■ ■ ■ + x'^ (modulo a factor 1/2) serves 
as a non-increasing Lyapunov function. The present situation is only a very 
simple manifestation of the interplay between passivity ideas and coordination 
and synchronization tasks. We refer to the paper 1^ for more on this intimate 
relationship. 

Apparently by coincidence, the condition that the Metzler matrix A{t) has 
zero column sums in addition to zero row sums implies that the sum xi + - ■ ■+Xn 
is constant along the solutions of (^). Indeed, the sum xi + ■ ■ ■ + Xn may be 
written as e'x and its time-derivative {d/dt)e'x = e'A(t)x vanishes for all x 
when e'A(t) = 0. We may thus add any (nonlinear) function of a;i -I- • ■ • -I- a;„ to 
S{x) without changing the time-derivative. In particular, we may replace the 



8 



sum of squares Lyapunov function by 

df \ ( ^1 ^ ha;„y , 

j{x) — \xi + ■ • • + X 



Xi + ■ ■ ■ + Xn\ / Xi + ■ ■ ■ + Xr, 



n 

2 

Xi + ■ ■ ■ + Xn / Xi + • • • + .T„ ' 



— S{x) - 2{xi + • • • + Xn) h n 

n 

which satisfies S(t,x) = S{t,x). Unlike the original sum of squares func- 
tion S{x), the modified function S{x) has the appealing feature that it is in fact 
positive definite with respect to the equilibrium set of consensus states xi = 
■ ■ ■ = Xn- This Lyapunov function is used in |20[ I21| when distributed consen- 
sus algorithms are studied that leave the average value of the state components 
invariant. 

Finally, as has been recognized a long time ago, it is worth noticing that the 
requirement of zero row sums may be relaxed. In order to show this, let us start 
with rewriting the zero column sum requirement in the concise form e' A — 0, 
as we did before. The relaxation to be discussed here replaces the condition 
e'A = by the more general requirement p' A = where p is any vector with 
non-negative components. It has been shown that, if the system matrix is 
Metzler with zero row sums and satisfies p'A = then every function of the 
form Pif{xx) -f • • • + Pnf{xn) with / an arbitrary convex function of one real 
variable, is non-increasing along x = Ax. 

To summarize, the Lyapunov functions introduced in this section enable 
a stability analysis of distributed consensus algorithms. Advantages are that 
the coupling matrix is allowed to be time-dependent and that the approach 
may be extended to incorporate nonlinear interactions, as in |17|. Furthermore, 
the passivity interpretation points towards far-reaching generalizations involv- 
ing higher-order models; see |H9j . An important limitation, however, is that 
restrictions need to be imposed on the network coupling (balance conditions 
in terms of constraints on the column sums of the coupling matrix). A sim- 
ple leader-follower architecture with an alternating leader-follower relation as 
in i = A{t)x with A{t) switching between 

-1 l\ , 
oj ^'^^ [l 1 

for example, falls outside the scope of this method. 



3.3 Contraction property 

A third and last approach that we mention is based on the contraction property^ 
of Recall that the dynamics of one component, say Xk, is given by 

n 

Xk = ^ aki{t){xi - Xk) 

1=1, l^k 

*This terminology has been borrowed from the text book 1241 and should not be confused 
with the notion of contraction analysis advocated, for example, in 1371 14UI . 
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with Ukiit) > for k ^ I. This means that Xk is a non- negative hnear com- 
bination of the differences xi — Xk- In other words, each state component 
moves in the direction of the other state components. It is thus clear that 
max{a:i, . . . , a;„} is a non- increasing function of time. Likewise mm{xi, . . . ,Xn} 
cannot decrease. We may combine these two properties by introducing the Lya- 
punov function V{x) = maxjxi, . . . , x„} — min{a;i, . . . , x„} which is positive 
definite with respect to the desired equilibrium set {x e R" : xi = ■ ■ ■ = Xn} 
and non-increasing along the solutions of ^ . 

The contraction property mentioned here has been known for a long time, 
in particular in the context of discrete-time systems. It serves as a starting 
point for the ergodicity analysis of products of stochastic matrices |23]- As 
a matter of fact, even the application to distributed consensus algorithms is 
already mentioned in that reference; see |24[ section 4.6]. 

We illustrate below that, with the aid of the Lyapunov function V{x) = 
max{a;i, . . . , x„} — min{xi, . . . , we are able to establish convergence under 
very mild assumptions concerning the network coupling. Unlike the previous 
approaches, we do not need to assume symmetric coupling nor do we need 
to require detailed balance conditions such as zero column sums. The only 
assumption we have to make is a very mild connectivity assumption over time 
intervals. The obtained results complement and extend the discrete-time results 
reported by the author in [331 1^ • 

4 CONVERGENCE RESULT 

Theorem 1. Consider the linear system 

X = A{t)x (3) 

Assume that the system matrix is a bounded and piecewise continuous function 
of time. Assume that, for every time t, the system matrix is Metzler with zero 
row sums. If there is an index k G {l,...,n}, a threshold value (5 > and an 
interval length T > such that for all t CzM. the d-digraph associated to 

^ A{s) ds (4) 

has the property that all nodes may he reached from the node k, then the equilib- 
rium set of consensus states is uniformly exponentially stable. In particular, all 
components of any solution of JSJ converge to a common value as t ~> oo. 

Remark 1. See section \2.1\ for the precise definition of a 6-digraph and a node 
which may be reached from another node. 

Before we give a proof we first provide a brief discussion of Theorem^ The 
node k may be interpreted as a dominant system in the network in the sense 
that its initial state value will influence the final consensus value that will be 
reached. This, however, does not necessarily mean that we are dealing with a 
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leader-follower approach since there may be many other dominant systems in 
the network which will all contribute to the final consensus value. 

The connectivity condition featuring in the statement of the theorem is a 
very mild condition. For example, it does not require the existence of a system 
communicating directly to all other systems in the network at any given time 
instant. Instead, it allows the communication from one system to another to 
be indirect, involving intermediate systems. Also, the required communication 
does not need to occur instantaneously but may be spread over time. 

Clearly the piecewise continuity assumption is merely a technical condition 
which guarantees a proper meaning of In contrast to this, the bounded- 

ness assumption plays an instrumental role in the proof of Theorem^ Without 
this boundedness assumption, the conclusion of the theorem is no longer valid. 

4.1 Proof of Theorem [T] 

We consider V{x) = max{xi, . . . ,a;„} — min{a;i, . . . as a candidate Lya- 
punov function, where n is the dimension of the overall state space, x G K". 
This function is positive definite with respect to the desired equilibrium set {x G 
R" : xi — ■ ■ ■ = Xn} and non-increasing along the solutions of In general, 
the function V is not necessarily decreasing at every time instant. However, it 
is possible to show that V decreases over time intervals of sufficient length. 

In order to show that V decreases over time intervals of sufficient length 
we calculate conservative but explicit bounds for the trajectories of ©. The 
following lemma plays a crucial role in obtaining these bounds. 

Lemma 1. Consider the linear system 

X = A{t)x. (5) 

Assume that the system matrix is a piecewise continuous function of time and 
that, for every time t, the system matrix is Metzler with zero row sums. Let C, be 
a solution of ^ defined on the time interval [to, ti]. Consider two nonempty 
disjoint sets G and H satisfying GU H = {1, . . . ,n} and introduce the following 
numbers characterizing the coupling relative with respect to G and H on the 
time interval [to, ^i] 



• acH 


— J2keG,ieH It, 


[' aki{t) dt, 


• aHG 


— Y^keH. leG It, 


^ Oki (t) dt, 


• aHH 


= J2kAeH, k=il J 


aki{t) dt. 



where aki{t) denotes the element on the k-th row and l-th column of the ma- 
trix A{t). Introduce upper and lower bounds 5™'", g™^^ , /^™'" and associ- 
ated to the solution C, at time to 

. 5-- = minfeeG{a-(io)}, 
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. /i""" <niinfce{i^...,„}{a(io)}, 

• /i™'''' > maxfcg{i^...^„}{Cfe(io)}- 

The following estimates hold for the solution Q at time ti : 

• every component Ckiti), k G G, is contained in the interval 

• at least one component C/c(^i),. k G H, is contained in the interval 

j^min ^gmin _ ^min)^^ ^max _ (^max _ ^max-j^] ^ 

with 

^ e-o"aHG/\H\ 

l + c°-HHaHG/\H\+c^HHafjH' 
where \H\ denotes the number of elements in H . 

The first estimate may be interpreted as a growth restriction on the compo- 
nents Cfc(^i)i k G G, and the second estimate may be interpreted as a trapping 
region for at least one of the components Ck{ti), k G H. It is important to 
notice that the estimates provided in (O-JH)) depend exphcitly on the system 
matrix A(t) via the numbers acH, ohg and ohh- For each of these three 
numbers an upper bound is available because the system matrix is assumed to 
be a bounded function of time. In addition, for the second of these numbers, 
a lower bound is available if appropriate connectivity conditions are imposed, 
thus effectively yielding a lower bound for the number /? featuring in (U))-®.^ 

Proof of Lemma^ We start with proving the first of the two estimates; cfr. ©. 
Notice that, initially at time to, every component C^, G G, is contained in 
the interval [g"^"^, g"^^^]- A component (k, k € G, can only leave this interval 
when it is attracted by some of the other components (k, k G H. These other 
components Cfc, k £ H, (as a matter of fact, all components) are themselves for 
all times t > to confined to the interval [/i™'", n'"^'^^]. In view of this, it is not 
difficult to see that the accumulative communication (attraction) ogh from H 
to G yields a growth restriction on the components (^k, k £ G. Intuitively, it 
is clear that a maximal growth is realized if all communication from H to G 
is actually coming from one or more components Ck, k G H, situated at one 
of the extremal positions, say, and directed to one component Cfc, k G G, 

originally situated at g™'*'^. In this situation, the component (k, k G G, receiving 
all communication would end up at position ^"^^'^ — (/i™^'^ — ^max-jg-acff ^ This 
reasoning provides some intuition for the upper bound in expression 0. 

^It is left as an exercise to the reader to show that upper bounds on acu and auH and a 
lower bound on a^Q yield a lower bound on /3. 
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A more formal argument goes as follows. Let us denote ^{t) = maxkQG{Ck{t)} 
and let us consider the time-evolution of this function. For almost every time 
instant t we have that ^{t) = (nit) and £_{t) = Cnit) for some (so-called extremal) 
index k G G, possibly depending on t. The following holds for this extremal 
index 



leH 

where we used the fact that (i < d for all Z G G \ {k} and Q < for 
all I G H. We don't need to know the precise index k since it always holds that 
GjeH ^ki{t)- We conclude that, at almost every time t, 

k£G, leH 

Hence, by integration, we have at time ti 

^ ^max _ ^^max _ ^max-jg-acff 

This explains the upper bound in expression l^. The lower bound may, of 
course, be demonstrated similarly. 

We now proceed with proving the second estimate of Lemma^ Suppose that 
at the final time ti every (k, fc G i/, is situated either in the interval [/i'"'", ft.™'") 
or in the interval {h"^'^^, n"^'^^], where /i""" and ft,"iax g^^,^ ^.g^j numbers 
sufhciently close to and n"^'^^, respectively. By a similar reasoning as above 
(growth restriction) we conclude that, initially at time to every (k, k ^ H, has 
to be situated either in the interval 



or in the interval 



j^min^ ^min ^ (^min _ ^rain-^^ann ) (9) 



(/i'"'''' - (^"^'^'^ - h"'^'')e''"" , /l™^'^] . (10) 



Here, we assume implicitly that the growth can only be caused by attraction 
from other components in H, but not from components in G. This implicit 
assumption is justified if the two intervals and pU|l do not overlap with the 
trapping region @ for components in G. This is the case if we restrict attention 
to values for /i™™ and /i™ax sufficiently close to /i™'" and fi"^^^, respectively. The 
above intervals © and I|1U|) hold not only at the initial time to, but also a fortiori 
during the complete interval [to, 

Now we turn attention to the communication from G to H . Since there are 
\H\ components in H, at least one of these components ^fc, k E H, receives a 
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total amount of aHG/\H\ communication during the interval [io, ^i]- Assuming 
that this particular component, whose index we denote by k, is in the right 
interval Qi™'^^, ^™'^^] at time ti and thus in the right interval ifTUIl during [to, ^i] 
(left would be similar) we have 

CK = ^aK/(i)(0-CK)+ ««iW(0-C«) 
leG ieH\{K} 

ieH\{K} 

where we used the bound © for components in G and the bound (|10|l for 
component as well as the upper bound ^('"^'^ for components in H. After 
integration we obtain 

It is clear that the upper bound we just obtained for CK.{ti) is getting tighter 
(monotonically decreasing) as h'^^^ increases towards fi™^^. At some value 
for /i™^'^ this upper bound actually yields a contradiction with our starting as- 
sumption, namely that Cuiti) is contained in the interval {h'^^^, fi"^'^^]. The 
critical value for /i™^'^ at which this contradiction first occurs is easily obtained 
by solving an algebraic equation and this yields the upper bound in expres- 
sion (UJ. The lower bound may, of course, be obtained similarly. This concludes 
the proof of the technical lemma. □ 

Let us now show how Lemma ^ may be used in order to conclude that the 
Lyapunov function V decreases over time intervals of length (n — 1)T. Con- 
sider an arbitrary solution <^ of (jSl and an arbitrary initial time ip. Intro- 
duce the singleton G S {1, . . . ,n} corresponding to (one of) the node(s) from 
which all other nodes may be reached for the (5-digraphs associated to 
Let H he {l,...,n}\G and let m™" = min{Ci(to), ■ • ■ , Cn(to)} and ^i'"^'^ = 
max{Ci(to), ■ • ■ , Cn(to)} — a choice which is compatible with the data introduced 
in Lemma d Notice that V{C{to)) = fi""^"^ - A first apphcation of 

Lemmanenables us to conclude that, at time to + T, the component of C{to+T) 
corresponding to the singleton G is contained in a compact interval of the 
form lO, which is strictly contained in [/it™'", n"^'^^]. At the same time, it en- 
ables us to conclude that at least one of the other state components Cfc(^o + T), 
k G H, belongs to an interval of the form (jjj), which is also strictly contained 
in [/z™'", ^'^^^].^ We may exclude (the index of) this particular component 

^Regarding this last statement, it is important to emphasize that the connectivity condition 
that we are assuming to hold provides a lower bound ana > ^ which is instrumental for our 
conclusion that the interval of the form J7J is strictly contained in , /i™'"'] . 
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from the set H and include it in the set G and invoke Lemmata second time — 
with the same, original values for /i™'" and ^'"^'^ but with the modified sets G 
and H. Continuing along these lines, we conclude after a repetitive application 
of Lemmanthat, at time t[j + {n — 1)T, all components of C(^o + [n — \)T) are 
contained in a compact interval which is strictly contained in the original inter- 
val [yU™'", /i™'*'^]. This shows that the Lyapunov function V has decreased over 
the time interval [to, tQ + (n~ 1)T] . The estimates that are obtained above by a 
repetitive application of Lemma^are conservative but explicit. They depend on 
the numbers acff , clhg and uhh as well as on the initial differences g™'" — /i""" 
and ^•"^'^ - 5""^'^. 

The discussion of the previous paragraph holds for every arbitrary solution C^. 
It establishes a decrease condition 

V(at^ + {n~ 1)T) - V{ato)) < 0. 

In addition, the above discussion provides conservative but explicit estimates for 
this decrease. Based on these explicit estimates we may conclude the existence of 
a continuous function "f{x) which is positive definite with respect to the desired 
equilibrium set {x £ M" : xi = ■ ■ ■ = Xn} and which satisfies 

ViCito + in- 1)T) - l/(C(to)) < -7(C(io)) 

for any solution ^ and any time tg. Fairly standard Lyapunov arguments may 
now be invoked in order to conclude that the desired equilibrium set is uniformly 
exponentially stable'', thus concluding the proof of Theorem ^ 

5 COMMUNICATION DELAY 

It is well-known that, in general, unmodelled delay effects in a feedback mech- 
anism may destabilize an otherwise stable system. This destabilizing effect of 
delay has been well documented in the literature. In the present context delay 
effects may arise naturally, for example, because of the finite transmission speed 
due to the physical characteristics of the medium transmitting the information 
(e.g. acoustic wave communication between underwater vehicles). 

As before, let us first consider a simple network structure with one single 
coupling. If we assume that the delay affects only the variable that is actually 
being transmitted from one system to another then it makes sense to assume 
that a link from system / to system k contributes to the dynamics as follows 

Xk{t) = aki{xi{t - t) - Xk(t)) 

which makes the real variable x^ evolve towards the delayed variable xi with a 
rate of change proportional to the difference xi{t — r) — Xk{t). More generally, 

^If the differential equations would be nonlinear then extra conditions would have to be 
imposed on the function 7 in order to conclude uniform exponential stability, but in the present 
context this is not needed, since uniform asymptotic stability and uniform exponential stability 
are equivalent for linear systems. 
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we consider the delay differential equation 

x{t) = diag {A{t))x{t) + - diag {A{t)))x(t - r) 

instead of J^Jl. Here diag (A) is the obvious notation for the diagonal matrix 
obtained from A by setting all off-diagonal entries equal to zero. Observe that 
the delay t is only featuring in those terms that correspond to the off-diagonal 
elements of A{t). Here and in the remainder of the paper r is a fixed positive 
real number. The stability result of the previous section is robust with respect 
to an arbitrary delay t. 

Theorem 2. Consider the linear system 

x{t) = diag {A(t))x{t) + {A{t) ~ diag {A{t)))x{t - r) (11) 

with T > 0. Assume that the system matrix A{t) is a bounded and piecewise 
continuous function of time. Assume that, for every time t, the system matrix 
is Metzler with zero row sums. If there is k £ {\, . . . ,n} , 5 > Q and T > such 
that for a// 1 e M the S-digraph associated to 

A{s)ds (12) 

has the property that all nodes may he reached from the node k, then the equilib- 
rium set of consensus states is uniformly exponentially stable. In particular, all 
components of any solution Q{t) of (lll() converge to a common value as t oo. 

This result can actually be proven following the lines of the proof of The- 
orem ^ The main ideas used in that proof essentially remain valid even if 
a delay is featuring in the equations. The most important modification is 
that now, instead of the Lyapunov function V{x{t)) = m.ax{xi{t), . . . , Xn{t)} — 
min{xi(t), . . . , Xn(t)} , we consider the Lyapunov functional 

V{xt) = max {xi{a), . . . ,Xnia-)} - min {a;i(CT), . . . , a;„(cr)}, 

cre[t-T,t] ae[t-T,t] 

where Xt is a standard notation from the theory of delay differential equations 
and denotes the time function x{a) on the interval a G [t — t, t]. Once this 
modification is in place, all the other modifications that have to be made are 
straightforward and left to the reader. 

Remark 2. Distributed consensus algorithms with delay have also been con- 
sidered in \2(\ \2Vl . In those references the delay is assumed to affect the off- 
diagonal terms as well as the diagonal terms in the differential equation. In that 
case a large delay value may, in fact, destabilize the algorithm. 

6 Conclusion 

An important trend in systems theory is to view a complicated system as an 
interconnection of simpler subsystems. Doing this, one hopes to be able to relate 
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the behavior of the overall system to the dynamics of the simpler subsystems as 
well as the interconnection topology. In the present study, we encountered a very 
special instance of this paradigm, were each individual system in the network 
has trivial integrator dynamics. We have shown that in this case, only very 
mild conditions need to be imposed on the interconnection topology in order to 
draw relevant conclusions for the overall system in terms of consensus reaching. 
These very mild conditions allow the communication to be time-dependent and 
non-bidirectional. In addition, arbitrary time-delays are also allowed. It would 
be of interest to identify other classes of systems beyond the simple integrators 
considered here, where similar mild conditions on the coupling topology suffice 
to draw conclusions about the overall system behavior. 

A possible contribution in this direction could come from the theory of mono- 
tone systems The model studied in the present paper is, in fact, a 
monotone, cooperative system — an observation which we have not explicitly ex- 
ploited in the present paper. It may be interesting to investigate how the present 
results relate to the recent work on cooperative systems, monotone systems and 
small gain theorems 02 QSj- This may possibly constitute a fruitful line of 
research. 
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